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A router discovery system for virtual routers automatically 
builds a multicast virtual network over an existing network 
topology. The virtual routers send out "heartbeats" across 
the Internet Protocol (IP) multicast network marked with a 
Time to Live (TTL) value containing the number of hops 
that the packet can take through the network before it gets 
discarded. The originating router gets an estimate of how far 
away the receiving router is when it receives the response 
packet from the receiving router (i.e. the receiving router is 
less than TTL hops away from the originating router). The 
invention uses the TTL values to find the closest routers. It 
balances the efficiency of the IP network connections with 
the distance of the routers to create a balanced network 
topology and establishes connections with the routers that 
meet these criteria. When a router comes alive, it sends out 
multicast packets across the network. Any routers that pick 
up the packets wait for a random amount of time and after 
the waiting period, if a router does not hear from any of the 
other routers that a connection was made, it establishes a 
connection with the new router. Ping messages are periodi- 
cally sent between the routers that have established connec- 
tions between themselves, testing the connection between 
the routers. The invention automatically and dynamically 
adapts to changes in the network topology. If a virtual router 
finds a more efficient connection to another router, it drops 
the less efficient connection. When a router goes down, the 
router's neighbors opens up connections to their next- 
nearest neighbors until the connectivity of the virtual net- 
work is restored. 

19 Claims, 5 Drawing Sheets 
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VIRTUAL ROUTER DISCOVERY SYSTEM TTL value contains the number of hops that the packet can 

take through the network before it gets discarded. 

BACKGROUND OF THE INVENTION originating router gels an estimate of how far away 

1 Technical Field lne receiving router is when it receives the response packet 

Tne invention relates to the setup and maintenance of 5 fr ° m %L™ eivin Z rou,e / C 6 * 6 «?? ^8 routcr «* if 5 

computer networks in a computer environment. More ^ ho P s ^ the B or f? atl ? 8 ^ 

particularly, the invention relates to the automatic setup of ™ eD>1 ° a ^ ' h ? ^ va ' ucs t0 find ,be dos f' J« 

virtual networks and adaptive reconfiguration of network ^• DC " *e effioeocy of the network connections with the 

i • . distance of the routers to create a balanced network IodoI- 

topology in a computer environment. , n uu " a ""' " l "f '" ",77 uaiau«*i u«w« » iuyui 

. ° . . lu ogy. Connections arc established with the routers that meet 

2. Description of the Pnor Art , hese criteria 

Virtual networks are created over the existing network when , rouU , r ^ ^ om multicast kets 

topology. The connectivity of the network is taken advan- acrQSS , he network . ^ routels ^ ick me kets wait 

tage of by creating an efficient routing system through the for , random of lime , f> ^ the waitin ^ a 

network, i.e. a virtual network. When setting up a virtual 15 router does no , hear &Dm aQy of mc omcr r<Juters tna , a 

network, it is necessary to configure the virtual routers to connection was made , it establishes a connection with the 

talk to each other. new mulct 

One common approach is to staticaUy configure which ping messages ^ periodically sent between the routers 

virtual routers will talk to other routers. The system admin- |hal have eslilblished connections between themselves. The 

istrator manuaUy enters the network connections into each 2° m messages tesl , he connectioD bel ween the routers. 

router. The network configuration does not change until the „ . . ,, 

system administrator manually changes it. This requires u Tbe ,Dven u Uon autom aUca "y dynamically adapts to 

maintenance and redundant links to get reliability because if changes in ^ topologyJf a virtual router finds a 

one router goes down, messages cannot get through until more e ® c,ent to another router, it may drop the 

,K.t ,„„,„, ° „_ 25 ' ess efficient connection. When a router goes down, the 

that router comes back up. . , • LL . . 

„ , . „„ , „. , , router s neighbors open up connections to their next -nearest 

Referring to FIG 1, a network backbone 101 has been neighbols unti i tbe connectivity of the virtual network is 

established in a local network and new users 102 103 want restored For , er reliability> routers may maintain redun- 

to connect onto the backbone. The new users 102, 103 may dant connections , 0 reduce service outages when their 

have to connect through the Wide Area Network (WAN) link jq ne jghbois go down. 

105 to get to the backbone, which is much more expensive. _ , , , ,,...„ 

If a new virtual router 104 is later added to the local network , 0thcr as P ccts and ^ v f a ^ cs ° f th .= mvcntlon . ™U 

101, then it would be more economical for the users 102, bec ° me a PP arcn | : from ^ f°U<™™g failed description in 

103 to connect through the local router 104 rather than «™°inat,on with the accompanying draw,ngs, illustrating, 

through the WAN 105. However, in a static configuration, js b y wa y of cxam P lc * the P nncl P lcs ° f thc invention, 

the system administrator must tell each of the useis 102 103 35 BRIEF DESCRIPTION OF THE DRAWINGS 
of the existence of the new router 104 and have them 

reconfigure their machines. FIG. 1 is a block schematic diagram of a network con- 

Another approach is to do away with the virtual multicast nection with an internal backbone and a Wide Area Network 

system and run directly over the Internet Protocol (IP) 4Q (WAN); 

multicast system. The drawback is that IP multicast is not FIG. 2 is a block schematic diagram of two sets of users 

flexible enough to perform the filtering that is needed. With in a multicast environment; 

respect to FIG. 2, a multicast application 201 has two sets of FIG. 3 is a schematic diagram of a heartbeat multicast 

users 202, 203 that are not interested in each other's traffic. packet accordmg to me invention; 

In an IP multicast system, either two multicast addresses AC rj ~ . . ... , ,. e . . A . 

tJ , i » l * i_ ii • w 4 45 FIG. 4 is a block schematic diagram of a virtual network 

would be needed which would be difficult to get . ,, 4 4 . . j 

.... „ r t , u ■ i - scenario accordmg to the invention: and 

authoritatively, or all of the users would simply receive , ° 

everyone else's traffic FIG. 5 is a block schematic diagram of a task oriented 

It would be advantageous to provide a virtual routing vi ™ of a P refcrred ™»>odiment of the invention according 

system that automatically sets up the virtual network topol- 50 0 c invention. 

ogy. It would further be advantageous to provide a virtual DETAILED DESCRIPTION OF THE 

routing system that adapts to changes in the network con- INVENTION 
nectivily by automatically reconfiguring the virtual network 

topology. As shown in the drawings for purposes of illustration, the 

55 invention is embodied in a virtual router system for com- 

SUMMARY OF THE INVENTION puter applications. A system according to the invention 

The invention provides a virtual router discovery system. provides a router discovery system capable of automatically 
The invention uses a router discovery system for virtual configuring a virtual network topology, 
routers that automatically builds a multicast virtual network A virtual router system according to the invention pro- 
over an existing network topology. In addition, the invention 60 v » d cs an easily configurable system that automatically sets 
uses an adaptable router system that enables the virtual up a virtual network on lop of a multicast network. The 
routers to reconfigure the virtual network topology auto- system additionally reconfigures the virtual network topol - 
matically in response to changes in the underlying network ogy to adapt to changes in the underlying network connec- 
connectivity. tivity. 

Tne virtual routers send out "heartbeats" across the Inter- 65 Configuration of the virtual network has been a difficult 

net Protocol (IP) multicast network. Each heartbeat multi- problem and has been a threat to the deployment of push 

cast packet is marked with a Time to Live (TTL) value. The network technology. The invention creates a multicast vir- 
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tual network built over the existing multicast network, e.g. virtual router x 404. The virtual router x 404 sends out 

a set of server processors (virtual routers) that talk to each multicast heartbeats. It does not hear anything from any 

other. When the sender wants to send out information, the other routers so it waits. Site B 402 starts up its virtual router 

routers perform the work to get the information to all of the y 408 and sends out heartbeats. Router y 408 starts to pick 

desired recipients. This technique is referred to as multicast 5 up router x*s 404 packets and, because no connection has 

because the router ideally sends no more than one copy of been opened between the two routers, either router opens a 

the information across a given network link. connection with the other and establish a link with the other 

Internet Protocol (IP) multicast operates in a similar site. Any client that is connected to either router can now talk 

fashion. IP multicast is used by virtual routers to find other to any of the clients connected to the other router. This 

virtual routers. The virtual routers send out periodic "heart- i° scenario continues on, with each router sending ping mes- 

beats" across the IP multicast network. Each heartbeat sages to each other to test the connection and measure the 

multicast packet is marked with a Time to Live (TTL) value. distance between each other. 

The TTL is the number of hops that the packet can take Another virtual router w 405 is started up at site A 401 and 

through the network before it gets discarded. A single hop is starts sending out heartbeats. The router w 405 is one hop 

from one IP router to another IP router. The heartbeat packet 15 405 away from router x 404 at site A 401. Router x 404 sees 

tells any virtual router within the TTL range that the sender that router w 405 is one hop away. It also sees that it cannot 

is alive. The sender finds its closest neighbors by starting the reach router w 405 through the current virtual network and 

TTL value at one and slowly increasing the TTL value. connects to it. The initiation of the connection can happen at 

Referring to FIG. 3, the heartbeat multicast packet 301 either router, 

contains the TTL value 303 in the header of the packet 302. 20 Router y 408 at site B 402 sees router w's 405 heartbeat 

The TTL value 305 is also placed in the body of the packet packets. It sees that router w 405 is four hops away. It has 

304. THE TTL value 308 is decremented at each hop, but the already established a connection with router x 404 at site A 

receiving router knows what the TTL value 305 is by reading 401 that is three hops 407 away. It forgoes creating a link 

the body of the packet 304. The originating router gets an with router w 405 because it has a connection to site A 401 

estimate of how far away the receiving router is when it 25 through router x 404 and it is more efficient to piggyback the 

receives the response packet from the receiving router (i.e. connection to router w 405 through this connection, 

the receiving router is less than TTL hops away from the Router z 410 at site c 403 starts t0 ^ neartbeats . It is 

originating router). The router uses the TTL values to find sevcn hops 4n away from sile A401 and ^ nops m away 

the closest routers. It balances the efficiency of the network from sile g 402. 7^ sitc A 40 i routers takes longer to see 

connections with the distance of the routers to create a router z 410 at sitc c 403 because router z 410 has to send 

balanced network topology. Connections are established a heartbeat with a TTL with at least seven for the routers at 

with the routers that meet these criteria. sile A m t0 xc the packet Routcr y 408 at site 3 m sees 

The system relies on the IP multicast network. The IP router z 410 almost immediately, 

network carries multicast packets. The address of the sender This prQtocol may ^ used lQ Qptimize a ne(work 

is contained in the multicast packet. If a router wants to talk topo i ogVf but lhe system does nol have to be tied to it. The 

to the sending router, it talks to that router through the mvenl i on automatically and dynamically adapts to changes 

established virtual network. If the virtual network does not in the netwQrk topolog) , U a virtual router ^ a more 

exist, then it attempts to connect to the sending router cffidcnt co^^ t0 anot h er router, it may drop the less 

anyway. ^ efficient connection. When a router goes down, the router's 

Although the invention is described as being applied to IP neighbors open up connections to their next-nearest neigh- 
multicast networks, one skilled in the art can readily appre- bors until the connectivity of the virtual network is restored, 
ciate that the invention can also be used with other under- p or greater reliability, routers may maintain redundant con- 
lying network protocols that provide receiver-directed mul- nections to reduce service outages when their neighbors go 
ticast services, permitting the sender to specify a limited 45 down. 

lifespan fo^packets in the same manner as a TTL value Referring to FIG. 5, the IP multicast system 501 carries 

described above. heartbeat packets across the IP network. The Manage Router 

When a new router comes alive, it sends out multicast Topology task 503 manages the virtual network connections, 

packets across the network. Any routers that pick up the It au t oma ticaUy updates the virtual network topology data- 

packets wait for a random amount of time before attempting 5Q b ase 509 with the latest connections to other virtual routers, 

to communicate with the new router. If, after the waiting Thc Manage Router Topology task 503 receives external 

penod, a router does not hear from any of the other routers heartbeat packets from the IP multicast task 501 and checks 

that a connection was made, it establishes a connection with the virtual oetwork topology database 509 for any new 

the new router. possible router connections. Distances to the other routers 

Ping messages are periodically sent between the routers 55 are calculated by the Calculate Router Distance task 504. 

that have established connections between themselves. The Th e Manage Router Topology task 503 can be configured to 

ping messages test the connection between the routers. create connections selectively with other virtual routers, 

Although the invention is described as being applied to such that it can filter out any section of the virtual network 

push networks, one skilled in the art can readily appreciate that it does not care about. Any connections with virtual 

that the invention can also be used for applications such as go routers are made through the Establish Router Connection 

Network News Transfer Protocol (NNTP) servers. Usenet task 502. As previously mentioned, the Manage Router 

requires static configuration. The invention allows the Topology task 503 determines if it is more efficient to open 

NNTP servers to discover other servers without requiring a new connection, route through an existing connection, or 

static configuration. drop an existing connection. If any new routers are 

With respect to FIG. 4, the majority of corporations have 65 discovered, the Manage Router Topology task 503 randomly 

fast connectivity within themselves. In this example of a picks a wait time and, after the timeout occurs, if it does not 

preferred embodiment, initially, site A 401 starts up its hear from any other routers that a connection has been 
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established with the new router, then it establishes a con- 5. The process of claim 1, wherein said managing step 

nection with the router. temporarily adapts the virtual network topology to work 

In order to maintain the virtual network, it is necessary to around missing routers and restores the virtual network 

be able to monitor its stale. Some virtual networks may topology when the routers reappear, 

permit the Manage Router Topology task 503 to perform this 5 6 * T° e process of claim 1, wherein said managing step 

monitoring explicitly; if so, this capability should be used. If determines whether it is more efficient to open a new 

not, however, it is possible to use ping messages to probe the connection, route through an existing connection, or drop an 

state of the virtual network. existing connection. 

Ping messages are sent by the Send Ping Message task , 7 * ™ e P^cess of claim 1 wherein said managing step 

507, which periodically tests connections by sending ping 10 a rand ° m backoff lime tempting to initiate a 

messages to all of the routers with established connections connection when a new router is detected, 

in the Virtual Topology Database 509. Pending ping mes- , 8 * The process of claim 1, wherein said managing step 

sages are logged in the pending ping messages database 510. * lcc * whlch ***** routere arc appropriate to add to the 

The responses to ping messages are recorded in the pending virtual network. 

ping messages database 510 by the Receive Ping Message 15 9.TT* process of claim 1, wherein said managing step 

task 506. In the case where the network setup allows the receives heartbeat packets from other routers, 

originating router to receive an indication that the ping 10 ™ c P roccss of claim ***** comprising the steps 
message did not reach the intended router, the Receive Ping 

Message task 506 tells the Manage Router Topology task sending periodic network monitoring messages to virtual 

503 that the router is missing. When there is no such 20 routers with established connections; and 

indicator, the Check Ping Message Timeout task 505 mea- answering network monitoring messages from other vir- 

sures the time elapsed since the ping message was sent to a tual routers. 

router. If a response does not arrive from a router that was 11. An apparatus for router discovery across a virtual 

sent a ping message within the timeout value, then the Check network in a computer environment, comprising: 

Ping Message Timeout task 505 notifies the Manage Router 25 a module for managing network topology, said managing 

Topology task 503 that the router is missing. module automatically sets upvirtual network connec- 

The Manage Router Topology task 503 updates the virtual tions; 

network topology database 509 with the missing router and a mo duIe for sending periodic ping messages to virtual 

adapts the virtual network topology to work around the 3Q routers with established connections; 

missing router It returns the network topology back to a moduk for reccivin ^ t0 said mg messagcs; 

normal when the missing router reappears. J , _ J . . . 

. . . , , , , a module for sending periodic heartbeat packets across an 

Any pings originating from other routers are answered by underlying network* 

the Respond to External Ping Messages task 508. , _ r . . /. t A . _. 

. . , . , a module for calculating router distance using Time to 

Every virtual router in the system operates in the same 35 y YC (ypL) values; and 

manner as described. . , e . c . . . 

a module for answering ping messages from other virtual 

Although the invention is described herein with reference routers, 

to the preferred embodiment, one skilled in the art will 12 ^ apparatus of claim u> further comprising: 

readily appreciate that other applications may be substituted fl module for de ffl routers 

for those set forth herein without departing from the spirit 40 ^ ^ ^ ^ ^ ^ m 

and scope of the present invention. According^ the inven- {Q es ^ ^ a 

uon should only be limited by the Claims included below. network t } ^ Q ^ ^ ^ 

C i aUn: c ■ i roulers ' 

1. A process for router discovery across a virtual network u ^ mm of claim u ^her comprising: 

in a computer environment, comprising the steps or: 4i B , r ■ . . - . . . , 

. . . a module for establishmg connections with virtual routers, 

managing network topology said managing step auto- 15 The ms of claim Uj whereirj ^ managing 

matically setting up virtual network connections; module temporarily adapts me virtual network topology to 

sending periodic ping messages to virtual routers with workaround missing routers and restores the virtual network 

established connections; 5Q topology when the routers reappear, 

receiving answers to said ping messages; 16. The apparatus of claim 11, wherein said managing 

sending periodic heartbeat packets across an underlying module determines whether it is more efficient to open a new 

network; connection, route through an existing connection, or drop an 

calculating router distance using Time to Live (TTL) eristing connection. 

values* and 55 The apparatus of claim 11, wherein said managing 

. module selects a random backoff time before attempting to 

answering ping messages from other virtual routers. midale a ronncclion when a new rouler is dctected . 

2. The process of claim 1, further comprising the step of: 18 ^ apparatus of claim llf whcrcin said managing 
delecting missing routers. module selects which virtual routers are appropriate to add 

3. The process of claim 1, wherein said managing step ■ 6Q l0 mc virtual network. 

adapts to network topology changes and updates a virtual 19. The apparatus of claim 11, wherein said managing 

network topology database with new and missing routers. module receives heartbeat packets from other routers. 

4. The process of claim 1, further comprising the step of: 

establishing connections with virtual routers. * * * * * 
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